Top-level acceleration of adaptive algebraic multilevel methods for steady-state solution to Markov chains

In many application areas, including information retrieval and networking systems, finding the steady-state distribution vector of an irreducible Markov chain is of interest and it is often difficult to compute efficiently. The steady-state vector is the solution to a nonsymmetric eigenproblem with known eigenvalue, Bx = x, subject to probability constraints ‖x‖1 = 1 and x > 0, where B is column stochastic, that is, B ≥ O and 1t B = 1t. Recently, scalable methods involving Smoothed Aggregation (SA) and Algebraic Multigrid (AMG) were proposed to solve such eigenvalue problems. These methods use multiplicative iterate updates versus the additive error corrections that are typically used in nonsingular linear solvers. This paper discusses an outer iteration that accelerates convergence of multiplicative update methods, similar in principle to a preconditioned flexible Krylov wrapper applied to an additive iteration for a nonsingular linear problem. The acceleration is performed by selecting a linear combination of old iterates to minimize a functional within the space of probability vectors. Two different implementations of this idea are considered and the effectiveness of these approaches is demonstrated with representative examples. Communicated by Rafael Bru and Juan Manuel Peña. H. De Sterck · K. Miller Department of Applied Mathematics, University of Waterloo, Waterloo, ON, Canada N2L 3G1 T. Manteuffel · G. Sanders (B) Department of Applied Mathematics, University of Colorado, 526 UCB, Boulder, CO 80309-0526, USA e-mail: [email protected] 376 H. De Sterck et al.